LAFTER: Lips and Face Real-Time Tracker

نویسندگان

  • Nuria Oliver
  • Alex Pentland
  • François Bérard
چکیده

This paper describes an active-camera real-time system for tracking, shape description, and classification of the human face and mouth using only an SGI Indy computer. The system is based on use of 2-D blob features, which are spatially-compact clusters of pixels that are similar in terms of low-level image properties. Patterns of behavior (e.g., facial expressions and head movements) can be classified in real-time using Hidden Markov Model (HMM) methods. The system has been tested on hundreds of users and has demonstrated extremely reliable and accurate performance. Typical classification accuracies are near 100%.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Lafter: Lips and Face Real Time Tracker with Facial Expression Recognition

This paper describes an active-camera real-time system for tracking, shape description, and classiication of the human face and mouth expressions using only a PC or equivalent computer. The system is based on use of 2-D blob features, which are spatially-compact clusters of pixels that are similar in terms of low-level image properties. Patterns of behavior (e.g., facial expressions and head mo...

متن کامل

LAFTER: a real-time face and lips tracker with facial expression recognition

This paper describes an active-camera real-time system for tracking, shape description, and classi"cation of the human face and mouth expressions using only a PC or equivalent computer. The system is based on use of 2-D blob features, which are spatially compact clusters of pixels that are similar in terms of low-level image properties. Patterns of behavior (e.g., facial expressions and head mo...

متن کامل

Preprocessing of visual speech under real world conditions

In this paper we present recent work on integration of visual information (automatic lipreading) with acoustic speech for better overall speech recognition. We have developed a modular system for exible human-computer interaction via speech. In order to give the speaker reasonable freedom of movement within a room, the speaker's face is automatically acquired and followed by a face tracker subs...

متن کامل

Hierarchical On-line Appearance-Based Tracking for 3D head pose, eyebrows, lips, eyelids and irises

In this paper, we propose an On-line Appearance-Based Tracker (OABT) for simultaneous tracking of 3D head pose, lips, eyebrows, eyelids and irises in monocular video sequences. In contrast to previously proposed tracking approaches, which deal with face and gaze tracking separately, our OABT can also be used for eyelid and iris tracking, as well as 3D head pose, lips and eyebrows facial actions...

متن کامل

Facial Features Tracking Applied to Drivers Drowsiness Detection

In this paper we describe a real time facial features tracker applied to the detection of some basic drowsiness behaviours in drivers, with a colour camera. It uses stochastic colour segmentation to robustly track a person’s skin and some facial features (eyes and lips).The system recovers 3D face direction, classifies rotation in all viewing directions and detects the driver’s state analysing ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1997